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Preface 


The recent fiscal crisis has brought American higher education to a watershed moment. After decades of 
expansive growth in enrollments and spending, state budget cuts and damaged endowments have 
driven double-digit increases in tuition over the past decade. In the wake of significant increases in 
federal student aid over the past four years, a growing federal deficit suggests that aid programs will be 
hard-pressed to keep up with the growth in tuition prices. Meanwhile, lackluster employment outcomes 
for recent college graduates and ballooning student loan debt have created an increasing sense of disil- 
lusionment among policymakers and the public alike. More than ever, Americans are questioning 
whether a college degree is worth the cost of admission. 

For their part, most colleges and universities have been reticent to rethink their cost structure— 
that is, what it actually costs to provide the education they deliver—in light of these fiscal challenges. 
Instead, they have typically chosen to raise tuition, cut course offerings, even close the door to qualified, 
tuition-paying students. In an era of declining public support and trust, battening down the hatches 
and waiting for sunnier days is not a recipe for regaining public confidence, let alone meeting our 
human-capital needs. 

But the future is not as bleak as it may seem. The stark fiscal challenges facing governments and 
endowments are forcing forward-thinking higher education leaders and entrepreneurs to reconsider the 
traditional model and to propose new, lower-cost modes of delivery and credentialing, arguments that 
resonate less during boom times. The prospect of reinventing higher education through online learning, 


long dismissed as being of low quality, has been renewed with the emergence of massive open online 
courses, some of which bear the imprimatur of elite universities. 


Elsewhere, some institutions and systems are experimenting with ways for students to earn their 
degrees more quickly and at a lower price. Even President Obama has chimed in, famously declaring in 
his 2012 State of the Union address, “Let me put colleges and universities on notice: if you cant stop 
tuition from going up, the funding you get from taxpayers will go down.” 

To make sense of these developments, AEI’s Education Policy Studies department, along with 
Kevin Carey of the New America Foundation, commissioned new research from leading academics, 
journalists, and entrepreneurs on how to do more with less in higher education. The collection of essays 
was first presented at an August 2012 research conference entitled “Stretching the Higher Education 
Dollar.” You can find conference drafts of the papers online at www.aei.org/events/2012/08/02 
/stretching-the-higher-education-dollar/. A revised set of those papers will be released as an edited vol- 
ume from Harvard Education Press in summer 2013. 

This forthcoming volume does a superb job of identifying the barriers to cost containment and the 
opportunities to fundamentally redefine the cost structure of higher education in the future. But after 
conversations with stakeholders across the country, we also recognized an appetite for concrete, near- 
term steps that policymakers and leaders can take to help get control of college costs, as well as clearer 
data on how higher education revenue and spending have changed over time. To help satisfy these 
needs, we commissioned three new pieces of research. 

In “Initiatives for Containing the Cost of Higher Education,” William E Massy, professor emeritus 
and former vice president for business and finance at Stanford University, offers a comprehensive reform 
agenda for policymakers interested in cost containment. Massy lays out a series of initiatives that, work- 
ing in tandem, can promote the larger goal of compelling colleges to spend money wisely. Among the 
individual reforms Massy proposes are creating a national database of cost-containment practices, a 
“Race to the Top” for college productivity, and process audits for all public institutions. The primary 
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aim, Massy contends, is to help provide the necessary information for a vibrant higher education mar- 
ket in a way that current policymakers and college leaders can get behind. 

In “Addressing the Declining Productivity of Higher Education Using Cost-Effectiveness Analy- 
sis,” Douglas N. Harris, associate professor of economics and university endowed chair in public edu- 
cation at Tulane University, takes a rigorous, empirical look at the cost-effectiveness of popular higher 
education policies and programs. Harris argues that policymakers and school leaders have far more 
control over productivity than assumed, but tend to lack the requisite information on which strategies 
will be most productive. Running through an array of these programs and policies—from class-size 
reductions, to various financial aid programs, to student services—Harris provides a framework that 
can help college leaders determine which policies and practices provide the most bang for our higher 
education buck. 

Finally, in “Public Policies, Prices, and Productivity in American Higher Education,” public policy 
consultant Arthur M. Hauptman examines the impact of federal and state policies on the escalating 
costs and diminishing productivity of higher education. After a brief overview of trends over the past 
40 years in college tuitions and spending, Hauptman offers a series of suggestions for federal and state 
policy reforms. Among these are restricting the use of private student loans, pegging tuition at public 
institutions to a general measure of a family’s ability to pay (such as median family income), and 
rethinking funding formulas to invest more in lower-cost public institutions like community colleges. 

We are excited to release these three papers as the concluding part of our Stretching the Higher 
Education Dollar series. Although the ideas in each are certainly open to discussion, we hope they pres- 
ent an informative and provocative set of actionable recommendations for policymakers and college 
leaders. For further information on the papers, or with any questions, please visit www.aei.org/policy 
/education/ or contact Daniel Lautzenheiser at daniel.lautzenheiser@aei.org. 


—Andrew P. Kelly 
Research Fellow, Education Policy Studies 
American Enterprise Institute 
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Addressing the Declining Productivity of Higher 
Education Using Cost-Effectiveness Analysis 


Douglas N. Harris 


Higher education productivity, as 
measured by academic degrees granted 
by American colleges and universities, 
is declining.’ Since the early 1990s, 
real expenditures on higher education 
have grown by more than 25 percent, 
now amounting to 2.9 percent of US 
gross domestic product (GDP)— 
greater than the percentage of GDP 
spent on higher education in almost 
any of the other developed countries.” 
But while the proportion of high- 
school graduates going on to college 
has risen dramatically, the percentage 
of entering college students finishing a 
bachelor’s degree has at best increased 
only slightly or, at worst, has declined.? 
Figure 1 shows the trend in 
productivity from 1970 to 2006, 
expressed in terms of the ratio of 
degrees granted to total sector expen- 
ditures.* The downward slope is steep- 
est among universities, where current 


productivity is less than half of what it 


FIGURE 1 
THE PRODUCTIVITY DECLINE, 1970-2006 (RATIO OF DEGREES 
TO EXPENDITURES IN PUBLIC COLLEGES, BASE YEAR=1970) 


1970 1974 1978 1982 1986 1990 1994 1998 2002 


——-BA Degree Productivity 
— — BA Degree Productivity, Adjusted 


-———- AA Degree Productivity 
— — AA Degree Productivity, Adjusted 


Source: National Center for Education Statistics, Digest of Education Statistics 1970-2006). 

Note: Expenditure data were not available beyond 2001, and therefore revenue data were used in their 
place. Expenditure data are in real (inflation-adjusted) 2006 dollars. Data were available only every five 
years during the 1970s; the intervening years are interpolated. Data on private colleges is only sporadically 
available and therefore excluded. 


was 40 years ago. Even when adjusted 
for the growth in overall labor costs in the economy 
(see dashed lines in figure 1), the decline in bachelor’s- 
degree production is nearly 20 percent. If these declines 
continue, maintaining the current rate of bachelor’s- 
degree production will cost an additional $42 billion per 
year 40 years from now.’ Thus, even if state support for 
public higher education did not continue to decline, 
tuition would have to increase by an average of $6,885 
per full-time equivalent (FTE) student in public universi- 
ties to maintain current spending, almost doubling 
today’s tuition.® 

What accounts for declining productivity in higher 
education? Prior research provides an array of potential 


Douglas N. Harris is an associate professor of economics and the 
university-endowed chair in public education at Tulane University. 


explanations.” Most analysts point to the role of rising 
costs, and others focus on declining degree attainment.’ 
Collectively, these explanations reinforce a widespread 
perception among higher education administrators and 
many scholars that productivity is impossible to control. 
According to economists Robert B. Archibald and David 
H. Feldman, “The problem in higher education is that 
productivity growth often is synonymous with lower 
quality. Adding more students to each class can diminish 
the benefit for each student, leading to diminished out- 
comes and lower graduation rates. Increasing the number 
of courses a professor teaches would reduce research or 
community service.” Similarly, in a study of college 
presidents’ attitudes, a two-year president said: “I dont 
think there are any more efficiencies left to be squeezed 
out of public universities across the nation. . . . There are 
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no more efficiencies to be had.”!° So, at least some insti- 
tutional leaders feel helpless when it comes to improving 
productivity without sacrificing quality.'! Even when 
costs are considered, institutions tend to focus on enrolling 
more students rather than helping them graduate.'* 

In this paper, I show that policymakers and college 
leaders do in fact have some control over productivity, 
but generally lack the information necessary to take the 
appropriate steps toward improvement. Specifically, deci- 
sion makers have little information about which programs, 
policies, and resource decisions are most cost-effective. 
Relative to other areas of public policy, cost-effectiveness 
analysis is rarely applied to specific education policies and 
programs.'? Even research that looks at the higher educa- 
tion system as a whole rarely considers the relationship 
between the costs and output—that is, productivity.!4 


Costeffectiveness analysis cannot 
and should not replace the judgment 
of educational leaders, but the 
information that comes from it can 


provide useful guidance and 


perhaps improve the way those 


decisions are made. 


A basic principle of decision making is that we have 
to compare the costs and benefits of all feasible options, 
but this rarely happens in analyses of higher education. 
Even those few studies that do consider cost-effectiveness 
do not attempt to compare across programs. This absence 
is hard to justify because there is little question that—as 
my analysis later in this paper shows—some programs are 
much more cost-effective than others. In addition, cost- 
effectiveness analyses often ignore the practical constraints 
of decision makers, such as the availability of state or fed- 
eral matching grants and pressures to boost college rank- 
ings. This paper tries to avoid that problem by addressing 
the distinctive features of higher education and laying out 
key questions policymakers need to ask themselves when 
interpreting the results of cost-effectiveness analyses. 

After outlining a method for applying cost-effective- 
ness analysis to higher education, I apply the approach to 


a variety of well-known programs, ranging from financial 
aid to student services and alternative modes of instruc- 
tion. Although the estimates that come out of this analy- 
sis may be useful by themselves, the main aim of this 
paper is to highlight a different way of thinking about the 
decisions policymakers and college leaders face and pro- 
vide a concrete way forward that can help reverse declin- 
ing productivity. Cost-effectiveness analysis cannot and 
should not replace the judgment of educational leaders, 
but the information that comes from it can provide use- 
ful guidance and perhaps improve the way those deci- 
sions are made. 


Basic Elements of Cost-Effectiveness 
Analysis for Higher Education 


Cost-effectiveness analysis may sound like a complicated 
academic concept, but the truth is that we use this type 
of thinking in our daily lives. When buying a car, many 
people look at ratings in Consumer Reports, for example, 
to find information about the “best values.” This analysis 
is just another way of saying the cars are good, given what 
you have to pay—that is, they are cost-effective and have 
a large “bang for the buck.” This kind of cost-effectiveness 
analysis is not to say that the approach is simple. Not 
everyone would agree on what cars represent the best 
value because different people prefer different types of 
cars and have different driving needs. But it is a useful 
way to think about and make choices. Given how com- 
mon this mode of thinking is, it is striking that cost- 
effectiveness analysis is often absent in higher education. 
As leaders come under increasing pressure to maintain or 
improve student outcomes in times of tight budgets, they 
are likely to find this kind of analysis not only useful, 
but necessary. 


Calculating and Standardizing Effectiveness-Cost and 
Benefit-Cost Ratios. The primary metric for understand- 
ing the relationship between program costs and their 
effects is the effectiveness-cost ratio (ECR). The first 
component of the ratio is the cost of a given policy or 
program, measured by the “market price” of the various 
components such as the salary and benefits of staff 
involved in the program and the cost of maintaining or 
expanding facilities necessary to implement it.!° 
Unfortunately, data on higher education costs are 
notoriously incomplete, and remarkably few studies of 
particular higher education interventions report the 
resources or “ingredients” involved or the prices that have 
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to be paid for them. For this reason, in my analysis of 
well-known college programs, I often had to estimate 
them myself by making informed assumptions. For 
example, most publicly available descriptions of programs 
provide a general sense of the number and type of staff 
involved in programs. To estimate total costs, I started 
with this information and then used nationally repre- 
sentative data on the salaries of workers in similar occupa- 
tions and professions. Going forward, policymakers and 
institutional leaders should insist on and collect granular 
measurements of cost to assess cost-effectiveness. 

Decision makers also need to know whether the pro- 
grams they are spending money on are effective. But in 
what sense do they need to be effective? Policy and research 
have traditionally focused on providing access to higher 
education, though the new “completion agenda” has 
drawn attention to measures of student success (retention, 
credit accumulation, and degree completion). I focus my 
analysis on degree completion because this outcome aligns 
with goals of students, policymakers, and, increasingly, 
institutional leaders. We need to recognize, however, that 
focusing on a single outcome such as degrees may rein- 
force a trend toward narrowing the functions of education 
only to those that we measure. The practical implication is 
that, in using this evidence to make policy decisions, we 
need to account for potential tradeoffs among multiple 
outcomes—degree completion and degree quality, for 
example—in a more qualitative manner, with more rigor- 
ous evidence for some outcomes than others. 

A second issue is that it can be very difficult to know 
whether a given program really generates effects. Higher 
education research often relies on simple correlations; for 
example, students enrolled in a given program were more 
likely to graduate than the average or apparently similar 
students. But correlation is not causation. For example, 
does anyone really think that Harvard University has a 
high graduation rate because its programs cause students 
to do better? Of course not. Those students graduate 
because they had exceptional abilities, motivation, and 
other such qualities before they got to Harvard. Conversely, 
colleges and programs should not be punished because 
they serve students who are less likely to graduate—if any- 
thing, they should be rewarded and praised for it. For this 
reason, educational leaders should try to identify studies 
that use more rigorous methods, such as randomized trials 
and “natural experiments” where outcomes are compared 
before and after a program or policy started. (College lead- 
ers can even conduct some of this research themselves 
using their own faculties and well-trained institutional 
researchers. I will discuss this in more detail later.) 


Once we have credible estimates of costs and effects, 
we can combine them to calculate the ECR, or “bang” 
divided by “buck.” A standard metric in economic analy- 
sis is that larger ECRs generally imply greater productiv- 
ity.'° With an outcome such as graduation rate, it is 
intuitive to standardize program costs for an entering 
cohort of 100 students. This means that the costs also 
have to be calculated for the whole group. For example, 
consider a program that costs $500 per student, or 
$50,000 for a group of 100 students. If the same pro- 
gram increases the graduation rate by one person (per 
100), then the ECR is 1 divided by 50, which equals 
0.02. (The denominator of 50 represents the $50,000 in 
costs expressed in thousands of dollars so as to avoid 
extremely small numbers like 0.00002.) 

A key strength of ECRs is that they express outcomes 
in easily digestible terms. Degrees and costs are ideas that 
educational leaders can easily grasp.'’ When calculated in 
comparable ways, ECRs can also be used to make com- 
parisons across programs, so we can say whether one pro- 
gram is more cost-effective than another. With a fixed pot 
of money, this approach helps allocate resources in ways 
that generate the best results for students. 

Economists often take this type of analysis a step 
further by calculating the monetary value of effects. In 
higher education, the most prominent example of mone- 
tary value is the earnings of graduates. The economic 
return to a degree, measured by increased earnings, is 
approximately $387,000 for a four-year degree ($282,000 
for a two-year degree), excluding other social benefits.'8 
Thus, as long as these benefit estimates exceed the dis- 
counted costs of producing a degree, the program passes 
a cost-benefit test, and the program is said to be “prof 
itable” from a societal standpoint. The advantage of this 
approach is that it allows not only comparisons among 
programs, but also more absolute judgments—regardless 
of whether there is a positive payoff. This is especially 
important when policymakers are considering adding 
resources to the system. The disadvantage of the approach 
is that the narrow focus on degrees is compounded by the 
additional focus on earnings. Understandably, educators 
are often leery of trying to place a dollar value on learn- 
ing. For this reason, and to concentrate attention on the 
potential power of cost-effectiveness, I focus only on 
ECRs. A more extensive and technical version of this 
analysis is available in another paper.!? 


Placing ECRs on a Level Playing Field. The goal is to 
create effectiveness-cost ratios that can be reasonably 
compared across programs. A key challenge is that, even 
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among those relatively few studies using rigorous meth- 
ods, different studies focus on different outcomes, requir- 
ing some type of conversion to a common metric. In 
higher education research, analysts commonly report 
effects on college entry and persistence only, rather than 
the primary outcome of interest—graduation. To place 
the estimates on a level playing field, I had to translate 
estimates of persistence effects into graduation effects 
using data and other research on the relationship between 
entry, persistence, and graduation. Because entry and per- 
sistence are prerequisites to graduation, a plausible range 
of estimates can be made this way.”° 


As leaders come under increasing 
pressure fo maintain or improve 


student outcomes in times of tight 


budgets, they are likely to find 


cost-effectiveness analysis not 


only useful, but necessary. 


The same goes for costs. Some programs last only one 
year, whereas others go for many years. Some of the longer- 
term programs have high attrition, so fewer students are 
served in later years; this affects the cost per student. There- 
fore, although I start by reporting costs in annual terms, 
the final calculations account for the number of years the 
average student participates in the program. 

Obviously many steps are involved in this analysis, 
and many assumptions are made along the way. I had to 
make some educated guesses about costs using public 
information and general market process. I also had to 
translate effects on entry and persistence into graduation 
and, in some cases, estimate how long the average student 
stays in a program. To provide some sense of the potential 
ranges for the ratios, I therefore report lower and upper 
bounds that account for some of the uncertainty. 

But the fact that these bounds are necessary presents 
another argument for college leaders to engage in their 
own rigorous experimentation. They have the data to 
track their own students’ outcomes, including degrees. 
They could also collect detailed cost data with a little 
more effort. And they could carry out their own experi- 
ments and pilot studies to determine what seems most 


cost-effective in their own institutions with their specific 
students and their possibly distinctive needs. These more 
local efforts can complement the more expensive and rig- 
orous studies funded by the federal government that are 
becoming somewhat more common but remain rare. 
College leaders do not need to wait for some miracle 
“cure” to arise from some national study when they have 
needs and resources of their own with which to work. 


Comparing ECRs: Challenges and Practical Questions. 
Even if there were no uncertainty in these calculations, 
policymakers would still have to be cautious about blindly 
adopting the programs with the largest ECRs. Specifi- 
cally, decision makers in higher education should ask 
themselves the following questions: 


¢ What outcomes did the study measure, and there- 
fore, how confident are we that the results translate 
to increased graduation? 


¢ How might the program affect quality? 


¢ Are we likely to see the same results if we implement 
the program in my state or institution? 


The answers to these questions establish the degree 
to which a given cost-effectiveness analysis is even rel- 
evant for a given decision. For example, a study that sug- 
gests large effects on the number of graduates is not very 
helpful if evidence also indicates substantial reductions in 
academic rigor. This might be a problem, for example, 
with a program that allows students to finish degrees 
more quickly. Or a study might examine effects on grade 
point average (GPA), but it is unclear how GPA translates 
to the desired outcome, such as graduation. 

Even if the answers to these basic questions suggest 
that a study is relevant to a given decision, other ques- 
tions about the local context have to be considered. The 
answers to the questions below will affect the likelihood 
that the outcomes of the study will translate to a particu- 
lar college or state: 


¢ Given the various funding streams and political con- 
straints, what are my truly viable options? 


¢ Are certain elements of these alternatives likely to be 
especially costly in my situation? (For example, pro- 
grams that require physical infrastructure might be 
more costly in urban campuses.) 
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e Are there secondary effects of the programs that are 
not reflected in the calculations? (State policymakers 
might worry, for instance, that financial aid generates 
budgetary costs and induces colleges to further raise 
tuition. Conversely, many people think of financial 
aid as part of a larger social contract, making cost- 
effectiveness a smaller consideration.) 


¢ Also, might it be possible to obtain third-party 
funding for some of the alternatives but not others? 
(Institutions may sometimes be able to find match- 
ing funds to reduce costs below what the cost- 
effectiveness analysis assumes. Likewise, state 
governments can seek funds from the federal govern- 
ment. More generally, although cost-effectiveness 
analysis treats all dollars the same, all dollars are not 
created equal among policymakers.) 


Finally, some leaders I have spoken with about the 
cost-effectiveness approach wonder about the usefulness 
of comparing different types of programs. Specifically, 
three different types of comparisons exist: (1) compar- 
isons across strategies (for example, instructional improve- 
ment versus financial aid); (2) comparisons across 
programs within strategies (for example, improving 
instruction through smaller classes versus instructional 
technology); and (3) comparisons within strategies but 
across student populations. I argue that the first two com- 
parisons are important for improving productivity, 
whereas the third raises equity concerns that I discuss in 
greater detail later on. 


Efficiency and Equity. The usual aim of cost-effectiveness 
analysis is to improve productivity and efficiency. But one 
of the central aims of education is to level the playing 
field in society so that everyone has a chance in life. This 
is one of the central arguments behind, for example, affir- 
mative action programs in higher education. 

Fortunately, cost-effectiveness analysis can be adapted 
to incorporate a broader notion of social welfare that 
includes equity. The first approach, which I call the subjec- 
tive approach, involves separately analyzing programs and 
policies aimed at different groups and then making qualita- 
tive judgments about the best balance of outcomes for all 
groups. The advantage of this approach is that it explicitly 
addresses equity while recognizing that equity can mean 
different things to different people. Some educational lead- 
ers might be more concerned with the equity of outcomes 
while others might be more concerned with ensuring that 
all students have the same opportunities available. 


Alternatively, the quantitative approach to equity 
gives numerical weight to the outcomes of groups whose 
success is of greatest concern. For example, I could multi- 
ply outcomes of disadvantaged student groups by a factor 
of two before summing across individuals. While this 
quantification imposes a strict definition of equity, it also 
reduces the likelihood that equity will be ignored in the 
final analysis. Numeric results are often taken at face 
value in policy deliberations, so handling equity subjec- 
tively can mean essentially ignoring the issue. As I discuss 
later, I use this simple mathematical approach in part of 
my analysis. 


Applying the Framework: The Cost- 
Effectiveness of Well-Known Programs 


To highlight the potential of the cost-effectiveness 
approach, I focus most of the remainder of this paper on 
applying the approach to a variety of higher education 
programs. This review is not meant to be comprehensive, 
but rather an illustration of the different ways that ECRs 
can be calculated and the issues that arise in the compar- 
isons. I sought a range of programs that varied on the 
basis of strategy employed (financial, instructional, student 
service), quality of cost information and impact informa- 
tion available, level of required resources, institutional 
context (two-year versus four-year colleges), and student 
population (targeted to disadvantaged students or broadly 
available). I define “disadvantaged” students broadly to 
refer to those whose families have below-average income, 
though the precise income cutoffs for program eligibility 
vary somewhat across programs placed in this category. 
Educators are often skeptical of economic reasoning 
in the context of program and resource decisions, raising 
concerns about “bean counters” who do not understand 
education and whose main goal is to do things cheaply. 
Therefore, I again emphasize that cost-effectiveness analy- 
sis identifies programs and policies that are not inexpen- 
sive per se, but inexpensive given the additional learning 
they produce. The analysis requires more than just count- 
ing costs and effects; it requires good answers to the 
questions posed earlier and in-depth knowledge of the 
institutional context, students served, and pedagogy. 


Common Hallmarks of Higher Education Quality: 
Student-Faculty Ratios and Full-Time Faculty. I begin 
with two resource-allocation decisions that have 
important effects on budgets and are widely seen as key 
indicators of quality—student-faculty ratios and hiring 
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of full-time faculty. Although much of the debate about 
higher education has moved beyond these resources, they 
still comprise 13 percent of U.S. News and World Reports 
undergraduate rankings.”! Here, I consider the costs of 
each, briefly summarize available evidence on impacts, and 
report ECRs using the previously explained methodology. 


Student-Faculty Ratio and Class Size. For a given faculty 
teaching load, a small student-faculty ratio means small 
class sizes. Faculty-student interaction outside the class- 
room may also be facilitated this way. Daniel Jacoby 
reports full-time faculty salaries of $74,443 ($58,041) 
and part-time faculty salaries of $16,156 ($12,174). 

The current student-faculty ratio (full-time-equivalent 
basis) is 14.8 (19.2) for public institutions.’? Four-year 
(two-year) colleges have two-thirds (one-third) of their 
courses taught by full-time faculty.?4 On the basis of these 
ratios and salaries (weighted appropriately by sector for 
the proportion of faculty who are part time and full time, 
and adding in fringe benefits), reducing the student-fac- 
ulty ratio from 15 to 14 (from 19 to 18) would therefore 
cost $32,561 ($9,477) per year for 100 students, exclud- 
ing capital costs and fringe benefits.” 

On the effect side of the equation, I found several 
studies of class size and achievement, and these tend to 
suggest that smaller classes do yield more learning.”® 
Because achievement effects cannot be readily translated 
into graduation rates, I rely on the recent work of econo- 
mists John Bound, Michael Lovenheim, and Sarah 
Turner.”” They find that reducing the student-faculty 
ratio by one increases degree completion by 1.11 (0.03) 
percentage points. The large differences between four-year 
and two-year results here are noteworthy. Although these 
results are based on fairly simple regression analyses, I do 
report the results because student-faculty ratio and class 
size are such important components of college costs. The 
adjusted ECR is 0.0083 (0.0015). 


Full-Time Faculty and Adjuncts. One way colleges have 
attempted to reduce costs in recent decades is through 
hiring adjuncts or part-time faculty. I calculate the costs 
of this change on the basis of data on percent part-time 
and full-time faculty salaries, as well as the precise num- 
ber of courses taught by part-time and full-time faculty.”® 
The costs of switching from the actual proportions to all 
full-time faculty would be $205,742 ($257,674). 

Ronald G. Ehrenberg and Liang Zhang estimate the 
effects of full-time faculty by comparing graduation rates 
and percent full-time faculty across time within colleges.”? 
The results of this approach imply that reducing the 


percent part time by 1.00 percentage point would reduce 
the graduation rate by 0.14 percentage points. Multiplying 
this by 33 (the actual percent part time) implies that elim- 
inating part-time faculty would increase the graduation 
rate by 4.6 percentage points. The authors do not report 
results for two-year colleges, but Jacoby does in his regres- 
sion analysis: increasing the full-time faculty by 1.00 per- 
centage point is associated with a rise in the graduation 
rate of 0.15 percentage points.*° To move from 33 percent 
to 100 percent full-time faculty would therefore increase 
graduation rates by 10 percentage points.*! The adjusted 
ECRs are 0.0055 (0.0181). The figure is much higher in 
the two-year sector because the effects appear larger and 
the costs smaller, compared with the four-year sector. 


College leaders do not need to 


wait for some miracle “cure” to 


arise from some national study when 


they have needs and resources of 


their own with which to work. 


College Access Programs. Policymakers have focused for 
decades on increasing access to higher education by tar- 
geting disadvantaged middle- and high-school students. 
Some of the oldest and most researched access programs 
are Upward Bound and Talent Search. 


Upward Bound. One of the original federal TRIO pro- 
grams aimed at increasing college access among low- 
income, first-generation students, Upward Bound 
provides tutoring and SAT and ACT test preparation, 
summer and after-school sessions aimed at improving 
language arts and math skills, and college campus visits. 
These regular interactions with students make Upward 
Bound more costly. Cohort cost estimates range from 
$480,000 to $516,000-$677,000.” The former and 
lower figure is based on federal budgetary contributions, 
and the higher figure range is based on opportunity costs 
in some specific sites, which reflects the general observa- 
tion that budgetary costs understate total resources. 

A randomized study of Upward Bound has yielded 
conflicting findings. One analysis by the organization 
that ran the experiment found no detectable effect on any 
college outcome, except for a 5 percentage-point increase 
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in vocational certificates and licenses.*? However, more 
recent analyses of the same data that Alan Nathan and I 
have examined suggest the estimated effects are very sen- 
sitive to the specific statistical techniques used and that 
the effects were likely positive for other high-school and 
college outcomes.*4 

Given the controversy over the estimates and the fact 
that the one area where the two analyses agree—effects 
on certificates and licenses—is considered less valuable 
than bachelor’s degrees, I use 2 percentage points as the 
baseline impact for average low-income students.*° This 
yields an adjusted ECR for average students of 0.0015.*° 


Talent Search. The second of the original federal TRIO 
programs (and the largest in terms of the number of 
students served), Talent Search provides a combination 
of academic support, career development activities, and 
financial aid assistance to high-school students.*” Spe- 
cific services include advice on test taking, study skills, 
academics, course selection, college orientation, college 
campus visits, referrals, counseling, financial aid coun- 
seling, and workshops. Federal contributions amounted 
to $392 per participant in 2009, which is considerably 
lower than other TRIO programs. The implied cohort 
cost is $39,200. With each of these college access pro- 
grams, I assume that the average student participates for 
1.5 years.78 

Studies of similar programs have used less rigorous 
propensity score matching (PSM) methods and found 
much larger effects. Jill M. Constantine and colleagues 
found that Talent Search improves college enrollment by 
6 to 18 percentage points (3 to 12 percentage points in 
two-year colleges and 3 to 7 percentage points in four- 
year colleges).>? Likewise, Thurston Domina found that 
these types of college outreach programs improve college 
enrollment by about 6 percentage points (though they 
have essentially no impact on high-school educational 
performance). Because of limitations in the methodol- 
ogy, I use the lower end of this range for the Talent 
Search impact estimates (ECR is equal to 0.0383). 


Financial Aid Programs. Tuition is the heavily subsidized 
price of college paid by students. The cost of these subsi- 
dies (in public institutions) and grants to students are 
essentially the face value of the subsidy or grant. Some 
grants and scholarships have “merit” requirements based 
on courses and grades. The situation is more complicated 
with loans. Susan Dynarski estimates that the govern- 
ment subsidy for Stafford loans, in which all interest is 
paid by the government while the student is in school 


and interest rates are subsidized after students leave col- 
lege, “is about a third of its face value.”*! This figure, 
however, is apparently based on what students with high 
credit ratings would obtain and probably overstates the 
credit situation of the average student. I estimate that 
the more typical subsidy is probably closer to 57 percent 
of face value.** I therefore assume that the cost to the 
federal government for a $1,000 loan is $600. This 
highlights how the cost of a $1 loan is less than the cost 
of a $1 grant. 

With several colleagues, I carried out the Wisconsin 
Scholars Longitudinal Study (WSLS), which randomly 
assigned first-time-in-college, low-income students up to 
$3,500 for each of their 10 semesters in four-year col- 
leges.43 We pointed out that, because of federal rules, aid 
officers are required to reduce certain forms of aid, espe- 
cially loans, when students receive grants and scholar- 
ships. For this reason, to calculate the cost of the WSLS, 
I added the net change in grant aid and subtracted the 
subsidy portion of the reduced loans.“ On the basis of 
some new results from this study, with data covering the 
first three years, the cumulative average cost per treatment 
student is $1,785 per year. This is to our knowledge the 
only randomized trial of a need-based aid program. 

The grants had small positive effects on GPA and 
credits, but no sustained impact on persistence.*” One 
reason is that much of the aid was supplanted; as noted 
above, federal rules required aid officers to reduce other 
forms of aid, and students chose to reduce their loans as a 
result of the new grant. Some of the analyses suggest that 
students who received the largest increases in their total 
aid saw positive effects on persistence to the second year 
of college, but other parts of the analysis suggest that the 
aid effects fade out in the third and fourth years. We 
therefore used a minimum of zero and a maximum of a 
2 percentage point increase in persistence.*° Combining 
this with the costs translates to an ECR of 0.0070.*” 


MDRC% Opening Doors. Some financial aid programs are 
bundled with other student services. MDRC’s Opening 
Doors project included an experiment that combined 
advising, counseling, and performance-based financial 
aid. On the basis of data from two community colleges, 
Lashawn Richburg-Hayes and colleagues reported that 
average total scholarship payment per student over two 
semesters was $1,246.48 Based on the number of coun- 
selors employed and the national average salaries of these 
workers, I estimate the costs of the counselors to be $340 
per student, so the total average cohort cost is $1,246 
plus $340, which equals $1,586 (per year for two years). 
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MDRC’s Opening Doors also included an experi- 
ment that combined services with performance-based aid. 
MDEC has released a series of reports suggesting that 
performance-based financial aid increases credit accumu- 
lation and enrollment in classes between the first and 
second semesters.*” More recently, they summarize new 
findings that the program increased persistence from 
roughly 31.0 percent to 37.5 percent over four semesters, 
for an effect of 6.5 percentage points. This suggests that 
the adjusted ECR is 0.0171. 


Canada STAR. While I generally focus on US-based 
results, | make one exception with the Canada STAR 
study. This is the only randomized trial of a performance- 
based aid program that occurred at a university, although 
another is ongoing. Like MDRC’s Opening Doors, the 
STAR study featured both financial aid and student serv- 
ices. In addition to the control group, there were multiple 
treatments: (1) services only, such as facilitated study 
groups; (2) scholarship money only; and (3) a combina- 
tion of services and scholarship money. The costs for 
these options are reported as $302, $366, and $739 per 
student, respectively.>° 

Joshua Angrist and colleagues reported a point esti- 
mate for the effect of the funding-only treatment on first- 
to-second-year persistence of 3 percentage points.”! This 
figure was not statistically significant, but a much larger 
impact (more than 6 percentage points) was significant 
for males. This is important partly because the program 
ended after the first year, so any effect on second-year 
enrollment would have been based on residual benefits 
from the first year rather than the expectation of contin- 
ued funding. This implies a 3 percentage-point impact of 
aid only and an adjusted ECR of 0.0200. The ECR for 
the combined financial aid and service is roughly half that 
size (0.0099) because the services almost doubled the costs 
and because the impact size remained roughly the same. 


Other Studies of Financial Aid. I reviewed a long list of 
studies and consulted the literature review by David Dem- 
ing and Susan Dynarski regarding the impacts from a 
large number of quasi-experimental studies.*” Researchers 
commonly report aid effects as increased rates of atten- 
dance per $1,000 in aid. These calculations typically refer 
only to a single year of aid from a given program— 
however, they omit costs from subsequent years if students 
remain in college and continue meeting the program 
requirements. For this reason, as well as because of the 
cohort basis of our approach, the ECRs cannot be com- 
pared with the usual impact per $1,000 of aid. There is 


much less evidence on the impact of loans, though the 
two quasi-experimental studies I know of both find posi- 
tive impacts. The adjusted ECRs are 0.0064 for loans 
and 0.0063 for grants, nearly identical to the estimate for 
the WSLS.™4 


Student Services. Other categories that can help increase 
the number of college graduates include student counsel- 
ing, student health services, and improved instruction, 
especially for students who are already far behind when 
they enter college. 


Student Counseling. As part of the MDRC Opening 
Doors initiative, low-income students who were just start- 
ing college and who had histories of academic difficulties 
were provided additional counseling and given a small 
stipend of $300 per semester when they used those 
services in two Ohio community colleges. The average 
stipend was $210. Counselors had a much smaller than 
usual caseload (119 versus 1,000 in the control group) 
because of the expectation that they would be spending 
more time with each student. Students were also given a 
designated contact in the financial aid office. Researchers 
found that students did use counseling and financial aid 
services at greater rates than control group students (who 
also had access to standard campus services). On the basis 
of the number of counselors involved and the Bureau of 
Labor Statistics data on average counselor salaries, I esti- 
mate counselor costs of $340 per year per student. After 
adding counselor time to the student stipends, I find that 
the unadjusted cohort cost is $54,898. 

MDEC studied the Opening Doors initiative with 
a randomized trial. Impacts were statistically significant 
during the one year the services were provided, though 
most of the initial effects diminished over time. The treat- 
ment increased persistence by 7 percentage points in the 
first semester by the end of the first year, after which 
point the program ended. Follow-up analysis suggests 
that the post-program impact was cut in half (to 3.7 per- 
centage points) the first full semester after the program 
stopped and declined further thereafter. It is unclear what 
would have happened had the program continued. The 
impacts might have diminished even if the program had 
continued. More plausible is that the total impact of the 
program might be reflected in the impact estimated at the 
time the program ended, increasing the graduation rate 
by 3.7 percentage points. As an upper bound, consider 
that the impacts could have continued to accumulate if 
the program continued—that is, the program might 
have impacted the persistence rate, and the initial benefits 
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might have been compounded. I take 3.7 percentage 
points as a middle-ground estimate of the impact on 
graduation. The adjusted ECR is 0.0281. 


Miscellaneous Student Services. Douglas A. Webber and 
Ronald G. Ehrenberg pointed out that spending on non- 
instructional student services such as student organizations, 
intramurals, student health services (including psychologi- 
cal counseling), supplemental instruction (for example, 
tutoring), and admissions and registrar offices have grown 
more rapidly in recent years than instructional expendi- 
tures.°° They used institution-level data from the Integrated 
Postsecondary Education Data System (IPEDS) to study 
the potential impacts of different categories of student 
services as well as other typical categories of college spend- 
ing.®° They found that spending on student services tends 
to increase student persistence, especially at colleges where 
students have low scores on college entrance exams and have 
lower family incomes. Instructional spending is also posi- 
tively associated with graduation. Specifically, they found 
that a $500 per student increase in student services spend- 
ing would increase the college graduation rate by 0.7 per- 
centage points. This yields an adjusted ECR of 0.0034. 
The adjusted ECR for the Opening Doors program 
(0.0281) is six times larger than that suggested by Webber 
and Ehrenberg (0.0034). What explains this divergence? 
Although the general spending on student services that 
Webber and Ehrenberg study reflects somewhat different 
types of services than in the MDRC experiment, and 
notwithstanding Webber and Ehrenberg’s careful analysis, 
the large difference in ECRs may suggest that the regres- 
sion-based estimates are biased downward. Also note that 
Webber and Ehrenberg focused on four-year students, 
whereas Opening Doors focused on two-year students. 


InsideTrack. The company InsideTrack provides coaching 
services to nontraditional college students (average age of 
31 years). According to Eric Bettinger and Rachel Baker, 
“The coaches call their students regularly and in some 
cases have access to course syllabi, transcripts, and addi- 
tional information on students’ performance and partici- 
pation in specific courses. InsideTrack uses this additional 
information in a set of predictive algorithms that assess 
each student’s status for the purpose of reaching out to 
them on the right issues at the right times.”°” The com- 
pany charges a fee of $1,000 per year per student. Because 
the service is provided by a for-profit company, this price 
is likely to be a reasonable estimate of costs, though it is 
unclear whether colleges themselves incur other costs. I 
use the reported price. 


The InsideTrack coaching program has been studied 
with a large multisite, randomized trial and is one of the 
most convincing studies available. Bettinger and Baker 
reported effects on both persistence and graduation.*® 
Even though the services are only provided for one year, 
effects on university graduation were 4 percentage points. 
This yields an ECR of 0.0400. 


Spending on student services tends 


to increase student persistence, 
especially at colleges where 
students have low scores on 
college entrance exams and 


have lower family incomes. 


Remediation. So far, I have considered programs that 
attempt to influence students indirectly—by changing the 
general faculty resources available (student-faculty ratios 
and adjuncts), providing various forms of services (for 
example, counseling and mentoring), and providing 
financial aid. But this means I have ignored what is 
arguably the core activity of colleges: instruction. Although 
few if any studies link instructional practices to persist- 
ence and graduation, researchers have paid considerable 
attention to remediation in recent years. 

One growing concern is that students who enter col- 
lege are not adequately prepared for college-level work. 
Although this situation is partly seen as a flaw of high- 
school preparation, many colleges try to address the issue 
through remediation programs. Placement in remediation 
is often based on standardized test scores. Texas spends 
$172 million per year on remediation programs that edu- 
cated 162,597 (mostly four-year) students in 2006.*° This 
translates to $1,057 per student, or $105,700 per cohort. 
Isaac McFarlin and Francisco Martorell found that reme- 
diation in Texas had no influence on student outcomes.°° 

Some researchers have expressed. concern, however, 
that the quality of the typical remediation program is rela- 
tively low and that more extensive, high-quality programs 
would have a positive impact. Alicia C. Dowd and Laura 
M. Ventimiglia estimate the costs of a high-quality reme- 
diation program, Pathways, which includes a combination 
of math and language arts.°! They estimate total costs of 
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TABLE | 
COsT-EFFECTIVENESS OF HIGHER EDUCATION PROGRAMS 


Adjusted Cohort 


Program Cost (Real $) 


Effectiveness- 
Cost Ratio (ECR) 


Estimated Effect 
on Graduation 


College Access (disadv) 
Talent Search 
Upward Bound 


58,800 
1,015,500 


Financial Aid 
Grants 
WSLS-min 
WSLS-max 
Loans 
Merit Aid (GA/AR) 
Merit Aid (Canada STAR) 


355,000 
633,675 
284,710 
233,700 
410,000 
150,060 


Financial Aid with Services 
Canada STAR 
Opening Doors (2y; disadv) 


302,990 
304,512 
Instruction 
Stud/Fac Ratio (4y) 
Stud/Fac Ratio (2y) 
Full-Time Faculty (4y) 


133,500 

20,281 
843,542 
551,422 
170,000 


Full-Time Faculty Qy) 

Remediation (Bett./Long) (disadv) 
Student Services 

Student Services (Webber/Ehr) 

Student Counseling (2y; disadv) 

Inside Track (4y) 


205,000 
105,404 
100,000 


2.25 0.0383 
1.50 0.0015 


2.25 0.0063 
0.00 0.0000 
2.00 0.0070 
1.50 0.0064 
3.00 0.0073 
3.00 0.0200 


3.00 0.0099 
5.20 0.0171 


Ll 0.0083 
0.03 0.0015 
4.60 0.0055 
10.00 0.0181 
10.00 0.0588 


0.70 0.0034 
2.96 0.0281 
4.00 0.0400 


Source: Author’ Calculations. 


Notes: Adjusted costs are the annual costs reported in the text multiplied by the average years of participation in the program. The effects on graduation some- 
times reflect effects reported in studies where the researchers studied graduation, and in other cases, they reflect an effect on college entry or persistence that is 
adjusted so that it reveals the expected effect on graduation. “GA/AR” refers to the Georgia and Arkansas residential scholarship. 


$1,700 per student session. This yields an unadjusted 
cohort cost of $170,000 per year, which, as expected, is 
somewhat higher than the cost of standard remediation 
that I reported earlier. 

Although some studies have identified positive short- 
term impacts of remediation on early persistence, two rig- 
orous studies find no impact on degree completion. 
Still, a quasi-experiment by Bettinger and Bridget Terry 
Long found that remediation increases the probability of 
receiving a degree by 10 percentage points.°? This 
leads to a bit of a conundrum. If we accept the results 
of McFarlin and Martorell, then the ECR is zero, but if 
we accept the results of Bettinger and Long, the ECR is 
0.0588. This case, along with the Upward Bound 


program case, are among the few instances where there 
are multiple rigorous studies, which allows such conflicts 
to emerge. 


Interpreting the Results 


The results of the cost calculations are summarized in the 
left-hand column of table 1. Costs for a cohort of 100 
students clearly vary widely, from as low as $20,281 for 
reducing the student-faculty ratio slightly in two-year col- 
leges to more than $1 million—50 times as much—for 
Upward Bound. From a productivity standpoint, this 
means reduced faculty-student ratios could produce tiny 
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FIGURE 2 
EQUuITY-ADJUSTED AND BOUNDED COST-EFFECTIVENESS RATIOS 


Inside Track 

Student Counselling (2y) 
Student Services (Webber/Ehr) 
Remediation (Bettinger/Long) 
Full-Time Faculty (2y) 
Full-Time Faculty 

Stud/Fac Ratio (2y) 

Stud/Fac Ratio 

Opening Doors (2y) 

Canada STAR (serv-+aid) 
Canada STAR (aid only) 
Merit Aid (GA/AR) 

Loans 

WSLS-max 

WSLS-min 

Grants 

Upward Bound 

Talent Search 


mECR from Table 1 


0.04 0.06 0.08 0.10 


m Equity-Adjusted ECR 


Source: Author’s Calculations. 


Notes: The darker bar for each program indicates the ECR from the text. The black bands within some of those lower bars indicate bounds for estimates 
where program evidence is only available for college entry or persistence and therefore where a range of impact multipliers are used. The equity-adjusted 
ECRs are based on the assumption that the outcomes of disadvantaged groups count twice as much as the average. The bands also apply to the equity- 
adjusted ECRs, but are omitted so that the x-axis spans a narrower range, allowing for greater clarity of the small ECR levels. “GA/AR” refers to the Geor- 


gia and Arkansas residential scholarship. 


impacts and still be worthwhile. Likewise, expensive pro- 
grams may be cost-effective, but only if they generate 
very large impacts on student outcomes. 

The second column of table 1 reports the estimated 
effect on graduation, and the last column divides the effects 
by the costs—the ECRs discussed throughout this section. 
The results vary widely, from an ECR of 0.0015 for 
Upward Bound and two-year faculty-student ratios to 
0.0588 for remediation. No single strategy stands out as 
particularly cost-effective. The results vary most within 
the instructional category, and financial aid seems to gen- 
erate more consistent but low cost-effectiveness ratios. 
Although the purpose here is not to draw conclusions 
about specific policies, these observations highlight the 
potential value of this approach. 

Most of the ECRs are related to four-year degrees, 
but the distinction between those and two-year degrees 
should not be forgotten. We also see evidence that pro- 
grams such as student services, which appear to be effec- 
tive in one sector (such as MDRC’s Opening Doors 


study of two-year colleges) seem ineffective in another 
sector (the Canada STAR study of a four-year college). 

Of course, all of this analysis assumes that we take 
the ratios at face value—that is, if we can ignore the ques- 
tions posed at the beginning of this chapter. I report the 
same point estimates from table 1 in figure 2 (the darker 
bars), but add bands to reflect the reasonable ranges. 
Some of the point estimates have no ranges because the 
estimates were based on actual graduation rather than 
assumptions about the multipliers to convert the esti- 
mates on entry and persistence. Of course, all the esti- 
mates contain unknown degrees of sampling error that 
are not reflected here. 

The lighter bars for each program in figure 2 reflect 
equity-adjusted ECRs under the assumption that the out- 
comes of economically disadvantaged groups are twice as 
important as those for the average student. If you agree 
with the equity adjustment, then you can focus only on 
the top bars. With this approach, targeted student coun- 
seling, Opening Doors, and WSLS (maximum estimate) 
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all see their ECRs leapfrog at least one program not tar- 
geted to disadvantaged students. Remediation could be 
added to the list because although family income is not an 
explicit consideration in assignment to remediation, disad- 
vantaged students are more likely to have the lower level 
of academic skills and test scores that trigger remediation 
participation. In this respect, a well-executed remediation 
may be the most cost-effective option for this group. 


The absence of the type of 


information that would be needed 
to improve productivity is perhaps 
the strongest evidence that we 
are falling short of our 


productivity potential. 


Recall that economists also sometimes carry out cost- 
benefit analyses that focus on the increased earnings of col- 
lege graduates. Benefit-cost ratios for most of the programs 
are available on request, but note that 72 percent of the 
programs discussed in table 1 pass a cost-benefit test. 
Among those that barely pass the cost-benefit test are 
grants, loans, and merit aid, though each of these also has 
many more cost-effective programs ranked above them. 
This highlights the fact that programs can look good when 
we examine them individually and consider only whether 
they pass a cost-benefit test, but the same programs look 
worse when we compare them to the alternatives. 

I recognize that some researchers might have alterna- 
tive definitions of “disadvantaged” and that some might 
value the outcomes of these groups in different ways. 
Also, precise impact estimates of the proportion of stu- 
dents deserving any disadvantaged designation are not 
available. Again, the advantage of including these equity- 
adjusted results is that they reduce the likelihood that the 
importance of equity will be lost in policy deliberations. 


Conclusion 


The combination of growing demand for college creden- 
tials and declining degree productivity is a serious prob- 
lem. It will be very difficult to reach the lofty education 


goals that US policymakers are setting—or even avoid 
continued decline in tight fiscal times—without improv- 
ing productivity. I argue, in contrast to the “cost disease” 
and the larger debate on higher education, that some pro- 
ductivity improvements are possible. Some programs are 
extremely expensive, with little evidence to justify those 
high costs. Moreover, the differences in measured cost- 
effectiveness are so large that it is hard to ignore them. 
Among those programs with positive effects, the largest 
ECR is 39 times larger than the smallest ECR. 

While the number and nature of the assumptions in 
the analysis should clearly give some pause when individ- 
uals use this research to inform policy, their main function 
is to prompt policymakers, researchers, and analysts alike 
to pose the questions necessary for reasonable interpreta- 
tions of the evidence. My goal with this analysis is to add 
some useful structure to those decisions, not to encourage 
decisions based on mindless and mechanistic applications 
of ECR rankings. There is a risk that the assumptions 
and caveats I have laid out here might be ignored in the 
decision-making process, which would partly undermine 
the objective, though that might be at least as likely if, as 
in most studies, these assumptions are never outlined. Of 
particular concern is that we have almost no evidence of 
the impacts of programs on degree quality. As with most 
tools, I think this one can be helpful if used well and can 
be possibly damaging if not used as intended. Given the 
significance of the cost and productivity problem, and the 
apparently vast differences in cost-effectiveness observed 
here, I believe this approach is worth considering. 

I do not claim that colleges could get back to pro- 
ductivity rates from decades past. The cost disease and 
other pressures driving costs up and degrees down are 
real, powerful, and to a certain extent unavoidable. But 
that should not excuse the dearth of rigorous evidence 
and the failure to integrate costs and effectiveness in pol- 
icy decision making. The absence of the type of informa- 
tion that would be needed to improve productivity—a 
hole that I hope this study begins to fill—is perhaps the 
strongest evidence that we are falling short of our produc- 
tivity potential. 

Going forward, new research will no doubt aid in 
filling some of the empirical gaps that hamper our analy- 
sis. Data for studying higher education are increasingly 
available for research purposes through, for example, the 
National Student Clearinghouse and developing state 
administrative data systems. Moreover, adding analysis of 
costs has long been possible but rarely carried out. I have 
provided a framework on which future cost-effectiveness 
research can be based, but this should not be left to just 
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the occasional review article. Every study of impacts 
should at least briefly discuss program costs, or else 
these studies will tell only half the story. College leaders 
should consider filling these research holes on their own 
because cost-effectiveness often varies depending on the 
campus context. 

The larger point is that colleges are not completely 
helpless in addressing productivity, as some appear to 
assume. These results suggest a need to break out of this 
mindset, to search actively for new and better ways to 
help students, and to study program costs and effects 
more carefully so that policymakers and college leaders 
can make more informed decisions about how to allocate 
scarce resources. 
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1. Note that here and elsewhere in the paper, I use “productiv- 
ity” and “efficiency” somewhat interchangeably, though, strictly 
speaking, the former refers to output per unit of input (for exam- 
ple, labor hours), whereas “efficiency” has a broader meaning. I 
adopt “productivity” here to align the discussion with how policy- 
makers more typically use the terms in this context. 

2. Charles T. Clotfelter, Buying the Best: Cost Escalation in Elite 
Higher Education (Princeton, NJ: Princeton University Press, 
1996); and Arthur Hauptman and Young Kim, Cost, Commitment, 
and Attainment in Higher Education: An International Comparison 
(Boston: Lumina Foundation and Jobs for the Future, 2009). 

3. Martha J. Bailey and Susan M. Dynarski, “Inequality in Post- 
secondary Education,” in Wither Opportunity: Rising Inequality, 
Schools, and Children’s Life Chances, ed. Greg Duncan and Richard 
Murnane (New York: Russell Sage Foundation, 2011); and John 
Bound, Michael Lovenheim, and Sarah Turner, Why Have College 
Completion Rates Declined? (working paper 15566, National 
Bureau of Economic Research, Cambridge, MA, 2009). 

4. This measure of productivity is imperfect because, for exam- 
ple, the resources included in the four-year (two-year) sector 
expenditures are not all supposed to go toward Bachelor of Arts 
(Associate of Arts) production, but the nondegree roles of colleges 
have not changed significantly over this time period, so this prob- 
ably influences the productivity level but not the trend. 


5. Productivity in 2006 was 81 percent of 1970 levels. Current 
expenditures in 2007 on four-year colleges were $196 billion. See 


US Department of Education, National Center for Education 
Statistics, 2003-04 through 2006-07 Integrated Postsecondary 
Education Data System, “Table 362: Expenditures of Public 
Degree-Granting Institutions, by Purpose of Expenditure and Type 
of Institution: 2003-04 through 2006-07,” 2010, http://nces.ed 
.gov/programs/digest/d09/tables/dt09_362.asp. Assuming the 
trend continues, productivity in 2050 will be 81 percent of 2010 
levels, and this will require an additional $42 billion to generate 
the same degrees. This slightly understates the additional resources 
because the figure represents only 36 years rather than 40, so the 
extrapolated productivity would actually be slightly larger. These 
calculations exclude two-year colleges because productivity is 
largely unchanged in that sector. The calculations also exclude pri- 
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